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Prototypical  Dynamic  Vehicle  Routing  Problem 


Given: 

•  a  group  of  vehicles,  and 
»  a  set  of  service  demands 


Objective: 

provide  service  in  minimum  time 
service  =  take  a  picture  at  location 


(All  info  known  ahead  of  time,  Dantzig  '59) 


Determine  a  set  of  paths  that  allow  vehicles  to  service  the  demands 


[  Dynamic  vehicle  routing 

(New  info  in 

9  New  demands  arise  in  real-time 

•  Existing  demands  evolve  over  time 

I  Dynamic  Vehicle  Routing  (DVR) 


i  DVR  for  Moving  Dema 
»  DVR  with  heterogeneoi 
.  DVR  with  priority  level: 


DVR  Load  Balancing  via  Terr 
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Given: 

®  a  group  of  vehicles,  and 
®  a  set  of  service  demands 

Objective: 

provide  service  in  minimum  time 
service  =  take  a  picture  at  location 


Vehicle  routing  (All  info  known  ahead  of  time,  Dantzig  '59) 


Determine  a  set  of  paths  that  allow  vehicles  to  service  the  demands 


1  Dynamic  vehicle  routing 

(New 

info  in  real 

9  New  demands  arise  in  real-time 

®  Existing  demands  evolve  over  time 
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Light  and  heavy  load  regimes 


Prototypical  Dynamic  Vehicle  Routing  Problem 


Given: 

®  a  group  of  vehicles,  and 
®  a  set  of  service  demands 

Objective: 
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service  =  take  a  picture  at  location 
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Literature  review  on  DVR 


®  Shortest  path  through  randomly-generated  and  worst-case  points 

(Beardwood,  Halton  and  Hammersly,  1959  —  Steele,  1990) 
®  Traveling  salesman  problem  solvers  (Lin,  Kernighan,  1973) 

®  DVR  formulation  on  a  graph  (Psaraftis,  1988) 

9  DVR  on  Euclidean  plane  (Bertsimas  and  Van  Ryzin,  1990-1993) 

9  Unified  receding-horizon  policy  (Papastavrou,  1996) 

Recent  developments  in  DVR  for  robotic  networks: 

®  Adaptation  and  decentralization  (Pavone,  Frazzoii,  FB:  tac,  in  press) 

9  Nonholonomic  /  Dubins  UAVs  (Savla,  Frazzoii,  FB:  TAC  2008) 

9  Pickup  delivery  tasks  (Waisanen,  Shah,  and  Dahleh:  TAC  2008) 

®  Heterogeneous  vehicles  and  team  forming  (Smith  and  Buiio:  scl  2009) 
9  Distinct-priority  demands  (Smith,  Pavone,  FB,  Frazzoii:  SICON,  in  press) 

9  Moving  demands  (Bopardikar,  Smith,  Hespanha,  FB:  TAC,  in  press) 
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Algo  #1:  Receding-Horizon  Shortest-Path  policy 


Receding-Horizon  Shortest-Path  (RH-SP) 

For  77  €  (0,1],  single  agent  performs: 
l:  while  no  customers,  move  to  center 
2:  while  customers  waiting 

Q  compute  shortest  path  through  current  targets 
Q  service  77-fraction  of  path 
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RH-SP  analysis 


Implementation: 

»  NP-hard  computation,  but  effective  heuristics 


Stability: 
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Receding-Horizon  Shortest-Path  (RH-SP) 

For  77  €  (0, 1] ,  single  agent  performs: 
l:  while  no  customers,  move  to  center 
2:  while  customers  waiting 

O  compute  shortest  path  through  current  targets 
Q  service  77-fraction  of  path 


M.  Pavone,  E.  Frazzoli,  and  F.  Bullo.  Distributed  and  adaptive  algorithms  for  vehicle 
routing  in  a  stochastic  and  dynamic  environment.  IEEE  Transactions  on  Automatic 
Control,  August  2009.  (Submitted,  Apr  2009)  to  appear 
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RH-SP  analysis 


Implementation: 

a  NP-hard  computation,  but  effective  heuristics 


Stability: 

Q  queue  is  stable  if  service  time  <  interarrival  time 
length  shortest  path(n) 


O  service  time  = 


RH-SP  analysis 


Implementation: 

a  NP-hard  computation,  but  effective  heuristics 


Stability: 

O  queue  is  stable  if  service  time  <  interarrival  time 
length  shortest  path(n) 


Q  service  time  =  -  (n  =  #  customers) 

n 

O  queue  is  stable  if  (length  of  shortest  path(n))  =  sublinear  f(n) 


Worst-case  and  expected  bounds 


length  shortest  path(n)  <  f3worsty/n 
lim  length  shortest  path(n)  =  /3expected\/n 


Implementation: 

a  NP-hard  computation,  but  effective  heuristics 


(n  —  #  customers) 


Stability: 

O  queue  is  stable  if  service  time  <  interarrival  time 
length  shortest  path(n) 


O  service  time  = 


(n  —  #  customers) 


O  queue  is  stable  if  (length  of  shortest  path(n))  =  sublinear  f(n) 


RH-SP  analysis:  continued 


Adaptation:  the  policy  does  not  require  knowledge  of 
Q  vehicle  velocity  v,  environment  Q 
O  arrival  rate  A  and  spatial  density  function  f 
Q  expected  on-site  service  s 


Performance: 

O  in  light  load,  delay  is  optimal 

Q  in  heavy  load,  delay  is  within  a  multiplicative  factor  from  optimal 
O  multiplicative  factor  depends  upon  f  and  is  conjectured  to  equal  2 


no  known  adaptive  algo  with  better  performance 
very  little  known  outside  of  asymptotic  regimes 


Algo  #2:  Load  balancing  via  territory  partitioning 


RH-SP  +  Partitioning 
Each  agent  / : 

Is  computes  own  cell  v;  in  optimal  partition 
2:  applies  RH-SP  policy  on  Vj 
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Euclidean  TSP  and  Dubins  TSP 


Euclidean  TSP  (ETSP) 

a  NP-hard 

a  effective  heuristics  available 
a  length(ETSP)  G  0(yfn) 

Dubins  TSP  (DTSP) 

Given  a  set  of  points  find  the  shortest  tour  with  bounded  curvature 
a  not  a  finite  dimensional  problem 
a  no  prior  algorithms  or  results  (as 
of  2006) 

a  length(DTSP)  sub-linear  in  n  1 

K.  Savla,  E.  Frazzoli,  and  F.  Bullo.  Traveling  Salesperson  Problems  for  the  Dubins 
vehicle.  IEEE  Transactions  on  Automatic  Control,  53(6) :  1378—1391 ,  2008 
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Today's  Outline 


Q  Extensions 

a  DVR  for  Nonholonomic  Vehicles 


a  DVR  with  priority  t 
Q  DVR  Load  Balancing 
Q  Conclusions 
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Stochastic  DTSP 


Problem  Statement  Given  a  set  of  n  independently  and  uniformly 
distributed  points,  design  polynomial-time  algorithm  with  smallest 
expected  DTSP  tour  length 


Theorem:  For  n  iid  uniformly  distributed  points: 


E[length  of  DTSP(n)] 


?2/3 


Translating  demands:  problem  setup 


Translating  demands:  policies 


Problem  parameters: 

®  speed  ratio  v: 

_  demand  speed 
vehicle  speed 

«  arrival  rate  A 
®  segment  width  1/1/ 

®  deadline  distance  L 


L  =  +oo 

Stabilize  queue 

L  is  finite 

Maximize  capture  fraction 

V  <  1 

v>  1 

L  =  +oo 

Stabilize  queue 

L  is  finite 

Maximize  capture  fraction 

v  <  1 

\  - \ 

v>  1 

Not  possible  for  any  A  >  0 

Moving  demands:  more  general  scenarios 
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Relaxed  assumptions: 


«  Non-Poisson 
®  Non-uniform 
o  Different  speeds 
a  Different  directions 
®  Finite  capture  radius 


More  general  setup: 
o  Higher  dimensions 
®  Advance  information 


S.  L.  Smith,  S.  D.  Bopardikar,  and  F.  Bulk 
translating  demands.  In  IEEE  Conf.  on  Dec 
China,  December  2009 


I  Robotic  Coordination:  Brie 
I  Dynamic  Vehicle  Routing  ( 
)  Extensions 


*  DVR  with  heterogeneous  demands  requiring  teams 


DVR  with  heterogeneous  demands  requiring  teams 

Today's  Outline 

Problem  setup: 

*  •  • 

• 

©  ® 

•  Heterogeneous  vehicles 

a  Tasks  require  vehicle  teams 

V  * 

Q  Extensions 

Goal  Minimize  task  delay 

% 

Consider  only  unbiased  policies: 

• 

a  DVR  with  heterogeneous  demands  requiring  teams 

Equal  expected  delay  to  all  tasks 

*  V 

•  *. 

a  DVR  with  priority  levels 

a  Provably  efficient  policies  in  certain  scenarios 

a  Very  rich  problem 

S.  L.  Smith  and  F.  Bullo.  The  dynamic 

earn  forming  problem:  Throughput  and 

delay  for  unbiased  policies.  Systems  &  Control  Letters,  58(10-11) :709-715,  2009 
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DVR  with  priority  levels 

Today’s  Outline 

e  =  o.8o  W» 

Problem  setup: 

p  =  0.82  »  J 

a  n  vehicles 

Q  Robotic  Coordination:  Brief  Review 

a  Two  classes  of  tasks  a,  /3 

\  •  \  *  .  .  : 

»  a  -  high  priority 

Q  Dynamic  Vehicle  Routing  (DVR) 

»  (3  -  low  priority 

V  T- — g — 

•  / 

Q  Extensions 

/  * 

a  DVR  for  Nonholonomic  Vehicles 

Goal:  minimize  cDa  +  (1  —  c)Dg 

/  • 

a  DVR  for  Moving  Demands 

c  €  (0, 1)  gives  bias  toward  a 

a  DVR  with  heterogeneous  demands  requiring  teams 

a  Provably  efficient  policy 

Q  DVR  Load  Balancing  via  Territory  Partitioning 

a  Extends  to  m  classes 

S.  L.  Smith,  M.  Pavone,  F.  Bullo,  and  E.  Frazzoli.  Dynamic  vehicle  routing  with 

priority  classes  of  stochastic  demands.  SIAM  Journal  on  Control  and  Optimization, 

lllllllllllllllll 

Territory  partitioning  akin  to  animal  territory  dynamics 


Optimal  partitioning  cost  functions 


Tilapia  mossambica,  ‘‘Hexagonal  Red  harvester  ants,  "Optimization,  Conflict,  and 

Territories,"  Barlow  et  al,  '74  Nonoverlapping  Foraging  Ranges,"  Adler  et  al,  '03 


Sage  sparrows,  “Territory  dynamics  in  a  sage  sparrows 
population,”  Petersen  et  al  '87 


H(P,  v)  =  J2jv  f(\\q-Pimq)dq 

•  0  :  M2  — >  R>o  density 
a  f  :  M>o  — * ►  K  penalty  function 


From  optimality  conditions  to  algorithms 


Gossip  partitioning  policy 


H{p,  v) 


=t //(■«- 


Pi\\)(f>{q)dq 


Theorem  (Alternating  Algorithm,  Lloyd  ’57) 


O  at  fixed  positions,  optimal  partition  is  Voronoi 
Q  at  fixed  partition,  optimal  positions  are  "generalized  centers" 

O  alternate  v-p  optimization 

=>  local  optimum  =  center  Voronoi  partition 


O  Random  communication  between  two  regions 
Q  Compute  two  centers 
Q  Compute  bisector  of  centers 
O  Partition  two  regions  by  bisector 


MMRi 


F.  Bullo,  R.  Carli,  and  P.  Frasca.  Gossip  coverage  control  for  robotic  networks:  Dynan 
ical  systems  on  the  the  space  of  partitions.  SIAM  Review,  January  2010.  Submittec 


ssi p  pai 


e  implementation 


a  Player/Stage  platform 

•  realistic  robot  models  in  discretized  environments 

<»  integrated  wireless  network  model  &  obstacle-avoidance  planner 


Q  Robotic  Coordination:  Brief  Review 
G  Dynamic  Vehicle  Routing  (DVR) 

Q  Extensions 

o  DVR  for  Nonholonomic  Vehicles 
a  DVR  for  Moving  Demands 

a  DVR  with  heterogeneous  demands  requiring  teams 
a  DVR  with  priority  levels 

Q  DVR  Load  Balancing  via  Territory  Partitioning 

G  Conclusions 


Gossip  partitioning  policy:  analysis  results 


O  class  of  dynamical  systems  on  space  of  partitions 

i.e.,  study  evolution  of  the  regions  rather  of  the  agents 

Q  convergence  to  centroidal  Voronoi  partitions  (under  mild  conditions) 

Q  novel  results  in  topology,  analysis  and  geometry: 

Q  compactness  of  space  of  finitely-convex  partitions  with  respect  to  the 
symmetric  difference  metric 

Q  continuity  of  various  geometric  maps  (Voronoi  as  function  of 

generators,  centroid  location  as  function  of  set,  multicenter  functions) 

Q  LaSalle  convergence  theorems  for  dynamical  systems  on  metric 
spaces  with  deterministic  and  stochastic  switches 


conjectures  about  topology  of  space  of  partitions 
asymmetric  gossip  algorithms,  akin  to  stigmergy 
tolerance  to  failures,  arrivals,  and  dynamic  environments 


